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(54) Digital watermarking and banknotes 

(57) Machine-readable data is digitally water- 
marked into banknotes. Such watermarking can be opti- 
cally sensed and detected by various devices. In 
response, such devices can intervene to prevent ban- 
knote reproduction. This arrangement addresses vari- 
ous problems, e.g., the use of digital image editing tools 
to circumvent prior art banknote anti-copy systems. In 
some embodiments, visible structures characteristic of 
banknotes are also detected (e.g. by pattern recognition 
analysis of image data), and reproduction can be halted 
if either the visible structures or the digital watermark 
data are detected. In other embodiments, automatic 
teller machines that accept, as well as dispense, ban- 
knotes can check for the presence of digitally water- 



marked data to help confirm the authenticity of 
banknotes. In other embodiments, scanners, printers 
and photocopiers can be provided with digital water- 
marking capabilities so that image data, or printed out- 
put, produced by such devices includes digital 
watermark data, permitting subsequent identification of 
the particular device used. The digital watermarking can 
be effected by making slight alterations to ink color, den- 
sity, etc., or by texturing the microtopology of the ban- 
knote surface. Some embodiments effect the 
watermarking by modulating the width or placement of 
component lines that form line art imagery on the ban- 
knote. 
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Description 

Field of the Invention 

[0001] The present application relates to the use of 
digital watermarking in connection with banknotes and 
other security documents. 

Background and Summary of the Invention 

[0002] The problem of casual counterfeiting of ban- 
knotes first arose two decades ago, with the introduction 
of color photocopiers. A number of techniques were 
proposed to address the problem. 
[0003] U.S. Patent 5,659,628 (assigned to Ricoh) is 
one of several patents noting that photocopiers can be 
equipped to recognize banknotes and prevent their pho- 
tocopying. The Ricoh patent particularly proposed that 
the red seal printed on Japanese yen notes is a pattern 
well suited for machine recognition. U.S. Patents 
5,845,008 (assigned to Omron), and 5,724,154 and 
5,731,880 (both assigned to Canon) show other photo- 
copiers that sense the presence of the seal emblem on 
banknotes, and disable a photocopier in response. U.S. 
Patent 5,678, 1 55 (assigned to Sharp) notes that a great 
number of other features visible on banknotes (e.g. 
logos, stamps, signets, face values, symbols including $ 
and YEN, etc.) can similarly be used as the basis for 
banknote recognition. 

[0004] Other technologies proposed that counterfeit- 
ing might be deterred by uniquely marking the printed 
output from each color photocopier, so that copies could 
be traced back to the originating machine. U.S. Patent 
5,568.268, for example, discloses the addition of essen- 
tially imperceptible patterns of yellow dots to printed 
output; the pattern is unique to the machine. U.S. Patent 
5,557,742 discloses a related arrangement in which the 
photocopier's serial number is printed on output docu- 
ments, again in essentially imperceptible form (small 
yellow lettering). U.S. Patent 5,661,574 shows an 
arrangement in which bits comprising the photocopier's 
serial number are represented in the photocopier's 
printed output by incrementing, or decrementing, pixel 
values (e.g. of yellow pixels) at known locations by fixed 
amounts (e.g. +/-30), depending on whether the corre- 
sponding serial number bit is a "1" or a "0." 
[0005] Recent advances in personal computers, and 
color scanning and printing technologies, have greatly 
increased the level of casual counterfeiting. High quality 
scanners are now readily available to many computer 
users, with 300 dpi scanners available for under $100, 
and 600 dpi scanners available for marginally more. 
Similarly, photographic quality color ink-jet printers are 
commonly available from Hewlett-Packard Co., Epson, 
etc. for under $300. 

[0006] These tools pose new threats. For example, a 
banknote can be doctored (e.g. by white-out, scissors, 
or less crude techniques) to remove/obliterate the visi- 



ble patterns on which prior art banknote detection tech- 
niques relied to prevent counterfeiting. Such a doctored 
document can then be freely scanned or copied, even 
on photocopiers designed to prevent processing of ban- 

5 knote images. The removed pattern(s) can then be 
added back in, e.g. by use of digital image editing tools, 
permitting free reproduction of the banknote. 
[0007] Digital watermarking technologies provide 
novel ways to address the problem of counterfeiting - 

w overcoming many of the newly-emerging threats and 
providing other advantages not previously available. 
[0008] Digital watermarking (sometimes simply 
"watermarking") is a quickly growing field of endeavor, 
with several different approaches. The present 

is assignee's work is reflected in U.S. Patents 5,841,978, 
5,768,426, 5,748,783, 5.748,763, 5,745,604, 
5,710,834, 5,636,292, 5,721,788, and in laid-open PCT 
applications WO 95/14289, WO 96/36163, and 
W097/43736. 

20 [0009] Applicant's laid-open application WO 95/1 4289 
discloses a system for redundantly embedding plural bit 
codes in various electronic and physical media using 
noise-like signals, and notes that the invention may be 
applied to paper currency. One embodiment alters the 

25 micro-topology of the surface of a medium to effect 
encoding. Another embodiment is a scanner that 
embeds identification codes in its scanned output data. 
[001 0] Applicant's laid-open application WO 96/361 63 
discloses a reproduction kiosk for use in retail photogra- 

30 phy stores, permitting consumers to reproduce photo- 
graphs. The kiosk examines the consumer's photograph 
for embedded watermark data (e.g. indicating that the 
photograph is copyrighted), and interrupts reproduction 
of the photograph if such watermark data is detected. 

35 This application also discloses that information can be 
encoded in vector graphics and very-low-order bit- 
mapped graphics by slightly changing a line's contour, 
e.g. slightly up, down, left or right. 
[001 1 ] Other digital watermarking work is illustrated by 

40 U.S. Patents 5,734,752, 5,646,997, 5,659,726, 
5,664,018, 5,671,277, 5,687,191, 5,687,236, 
5,689,587, 5,568,570, 5,572,247, 5,574,962, 
5,579,124, 5,581,500, 5,613,004, 5,629,770, 
5,461,426, 5,743,631, 5,488,664, 5,530,759,5,539,735, 

45 4,943,973, 5,337,361, 5,404,160, 5,404,377, 
5,315,098, 5,319,735, 5,337,362, 4,972,471, 
5,161,210, 5,243,423, 5,091,966, 5,113,437, 
4,939,515, 5,374,976, 4,855,827, 4,876,617, 
4,939,515,4,963,998,4,969,041, and published applica- 

50 tions WO 98/02864, EP 822,550, WO 97/39410, WO 
96/36163, GB 2,196,167, EP 777,197, EP 736,860, EP 
705,025, EP 766,468, EP 782,322, WO 95/20291, WO 
96/26494, WO 96/36935, WO 96/42151 , WO 97/22206, 
WO 97/26733. Some of the foregoing patents relate to 

55 visible watermarking techniques. Other visible water- 
marking techniques (e.g. data glyphs) are described in 
U.S. Patents 5,706,364, 5,689,620, 5,684,885, 
5,680,223, 5,668,636, 5,640,647, 5,594,809. (More typ- 
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ically, digital watermarks are steganographic - that is, 
they are essentially imperceptible to human vision, 
serving to hide the embedded data before the viewer's 
eyes.) 

[001 2] Most of the work in watermarking, however, is 
not in the patent literature but rather in published 
research. In addition to the patentees of the foregoing 
patents, some of the other workers in this field (whose 
watermark-related writings can by found by an author 
search in the INSPEC database) include I. Pitas, Eck- 
hard Koch, Jian Zhao, Norishige Morimoto, Laurence 
Boney, Kineo Matsui, A.Z. Tirkel, Fred Mintzer, B. Macq, 
Ahmed H. Tewfik, Frederic Jordan, Naohisa Komatsu, 
and Lawrence O'Gorman. 

[0013] In Szepanski, A Signal Theoretic Method for 
Creating Forgery-Proof Documents for Automatic 
Verification, 1979 Carnahan Conference on Crime 
Counter measures, the author noted that overprinting of 
documents (e.g. money bills) with complicated line pat- 
terns is a deterrent against forgery, but does not convey 
meaningful information usable in an automatic verifica- 
tion procedure. He thus proposed superimposing a pat- 
tern representing plural bit data onto a document 
instead. The document is partitioned into as many 
square regions as there we data bits to be represented, 
and a carrier pattern is chosen. In regions correspond- 
ing to a "1" bit, the carrier pattern is added to the under- 
lying document samples; in regions corresponding to a 
"0" bit, the pattern is subtracted. An automatic verifica- 
tion procedure can then be employed to scan the docu- 
ment, correlate the scan data with the carrier pattern, 
and extract the digital data. The author particularly con- 
siders passports in which the passport photograph is so 
processed to convey the owner's name and date of 
birth. 

[0014] The artisan is assumed to be familiar with the 
foregoing prior art. 

[0015] In the present disclosure it should be under- 
stood that references to watermarking encompass not 
only the assignee's watermarking technology, but can 
likewise be practiced with any other watermarking tech- 
nology, such as those indicated above. 
[0016] Watermarking can be applied to myriad forms 
of information. The present disclosure focuses on its 
applications to banknotes, travelers checks, passports, 
stock certificates, and the like (hereafter collectively 
referred to as "security documents"), which are gener- 
ally characterized by use of line art imagery. However, it 
should be recognized that the principles discussed 
below can also be applied outside this particular field. 
[001 7] Most of the prior art in image watermarking has 
focused on pixelated imagery (e.g. bit-mapped images, 
JPEG/MPEG imagery, ^VGA/SVGA display devices, 
etc.). In most watermarking techniques, the luminance 
or color values of component pixels are slightly changed 
to effect subliminal encoding of binary data through the 
image. (This encoding can be done directly in the pixel 
domain, or in another domain, such as the DCT 



4 

domain.) In some systems, isolated pixels are changed 
in accordance with one or more bits of the binary data; 
in others, plural domain-related groupings of pixels (e.g. 
locally adjoining, or corresponding to a given DCT com- 
5 ponent) are so changed. In all cases, however, pixels 
have served as the ultimate carriers of the embedded 
data. 

[0018] While pixelated imagery is a relatively recent 
development, line art goes back centuries. One familiar 

10 example is U.S. paper currency. On the one dollar ban- 
knote, for example, line art is used in several different 
ways. One is to form intricate webbing patterns around 
the margin of the note (generally comprised of light lines 
on dark background). Another is to form grayscale 

is imagery, such as the portrait of George Washington 
(generally comprised of dark lines on a light back- 
ground). 

[0019] There are two basic ways to simulate gray- 
scales in line art. One is to change the relative spacinqs 

20 of the lines to effect a lightening or darkening of an 
image region. Fig. 1A shows such an arrangement; 
area B looks darker than area A due to the closer spac- 
ings of the component lines. The other technique is to 
change the widths of the component lines -- wider lines 

25 resulting in darker areas and narrower lines resulting in 
lighter areas. Fig. 1B shows such an arrangement. 
Again, area B looks darker than area A, this time due to 
the greater widths of the component lines. These tech- 
niques are often used together. 

30 [0020] In accordance with one aspect of the invention, 
security of a banknote (or other security document) is 
enhanced by marking its face with machine readable, 
generally imperceptible digital data by slightly altering 
the distribution of ink on the face of the banknote. The 

35 digital data can comprise plural bits, and may be 
encoded redundantly across the banknote (rather than 
marking the banknote at a single, localized region only.) 
The encoding can make use of a code signal or a dis- 
crete cosine transform. Two watermarks can advanta- 

40 geously be used in some embodiments, in which case 
these may be encoded with different robustness, or in 
accordance with different code signals. Some such ban- 
knotes may be provided with holograms as well, to fur- 
ther increase security. 

45 [0021 ] In accordance with another aspect of the inven- 
tion, a banknote (or other security document) is 
encoded with plural-bit digital data so as to facilitate its 
later machine identification. This may be accomplished 
by receiving initial banknote artwork together with the 

so plural-bit digital data. A pattern of data is next produced, 
in which the digital data is encoded. The initial artwork 
is then adjusted in accordance with this data, and the 
banknote is printed using the adjusted artwork. Again, 
the arrangement desirably effects a spatial spreading of 

55 the plural bits throughout the banknote. 

[0022] One such embodiment posits a virtual grid of 
points imposed on a line art image, with the points 
spaced at regular intervals in vertical and horizontal 
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directions. (The horizontal and vertical intervals need 
not be equal.) The virtual points may be imposed over 
some or all of the bill at equal vertical and horizontal 
spacings of 250 pm. In regions of the banknote having 
line art, the component lines of the line art snake in and 
amongst these virtual grid points. 
[0023] Each grid point is considered to be the center 
of a corresponding region. The luminance of the region 
is a function of the proximity of any line(s) within the 
boundary of the region to the region's center point, and 
the thickness of the line(s). 

[0024] To change the luminance of the region, the 
contour of the line(s) is changed slightly within the 
region. In particular, the line is made slightly thicker to 
decrease luminance; or thinner to increase luminance. 
(In this example, dark lines on light backgrounds are 
presumed.) The ability to effect these slight changes is 
then employed, in accordance with known pixel ation- 
based watermarking techniques, to encode binary data 
in the line art. If such a banknote is thereafter scanned 
by a scanner, the values of the pixel data produced by 
the scanner will reflect the foregoing alterations in lumi- 
nance values, permitting embedded watermark data to 
be decoded. 

[0025] In an alternative embodiment, the line widths 
are not changed. Instead, the positions of the lines are 
shifted slightly towards or away from certain virtual grid 
points to effect an increase or decrease in the corre- 
sponding area's luminosity, with the same effect. 
[0026] In accordance with another aspect of the 
present invention, reproduction of a banknote (or other 
security document) is deterred by encoding the ban- 
knote with plural bit digital data. Sampled image data 
corresponding to such a banknote is thereafter pro- 
vided, and analyzed to detect the presence of the digital 
data therein. If such data is detected, an appropriate 
intervention action is taken. 

[0027] In one such embodiment, the sampled image 
data is also analyzed to detect the presence of a visible 
structure characteristic of a banknote. The intervention 
action can be triggered on the detection on both, or 
either, of the visible structure and/or the digital data. 
[0028] The interventions can include preventing repro- 
duction of the image data, sending a message to a 
remote location to report processing of banknote data, 
or inserting forensic tracing data in the image data. 
[0029] In accordance with another aspect of the inven- 
tion, reproduction of a banknote (or other security docu- 
ment) is deterred by examining suspect image data 
corresponding to the sampled optical luminance of an 
object, and determining whether the suspect image 
data corresponds to a banknote. Both of these opera- 
tions are performed at a first site. If the suspect image 
data corresponds to a banknote, then a second, remote 
site is contacted and a report is sent regarding detection 
of banknote-related data. 

[0030] In accordance with another aspect of the inven- 
tion, output from the printer of a personal computer sys- 



tem is marked to permit its later identification. This 
method includes receiving (or intercepting) printer data 
being sent from the personal computer to the printer; 
and digitally watermarking this data with a machine 

5 readable, generally imperceptible, digital watermark 
(desirably spread throughout the printer data). This 
watermark serves to mark the printer data as having 
been printed by that particular printer, permitting the 
resultant document to be matched with that printer. 

io [0031 ] In accordance with another aspect of the inven- 
tion, an apparatus for processing (e.g. recognizing or 
validating) a banknote (or other security document) 
includes an optical scanner for producing image data 
corresponding to a note input to the apparatus, and a 

15 processor for detecting plural-bit digital watermark data 
within the image data. The detection of such watermark 
data indicates that the note is a banknote. If the water- 
mark data is detected, a control unit responds in a first 
manner to change or limit the apparatus's operation 

20 (e.g. by halting reproduction, inserting forensic tracer 
information in output data, alerting a remote site or serv- 
ice, etc.). If the watermark data is not detected, the con- 
trol unit responds in a second, different, manner. 
Scanners, photocopiers, and printers are examples of 

25 apparatuses that can employ such banknote-aware 
arrangements. 

[0032] In accordance with another aspect of the inven- 
tion, a cash processing apparatus includes an input for 
receiving plural banknote bills, and a feed mechanism 

30 for conveying bills from the input past an optical detec- 
tor. The optical detector produces digital image data 
corresponding to the conveyed bills. This image data is 
then processed by a processor, which detects plural-bit 
digital watermark data steganographically encoded in 

35 artwork on at least certain of said banknotes. A control 
unit responds in a manner dependent on the detected 
watermark data. 

[0033] The foregoing and other features and advan- 
tages of the invention will be more readily apparent from 
40 the following detailed description, which proceeds with 
reference to the accompanying drawings. 

Brief Description of the Drawings 

45 [0034] 

Figs. 1A and 1B show prior art techniques for 
achieving grayscale effects using line art. 
Fig. 2 shows a virtual array of grid points that can 
so be imposed on an image according to one embodi- 
ment of the present invention. 
Fig. 3 shows a virtual array of regions that can be 
imposed on an image according to the Fig. 2 
embodiment. 

55 Fig. 4 shows an excerpt of Fig. 3 with a line from a 
line art image passing therethrough. 
Fig. 5 shows changes to the width of the line of Fig. 
3 to effect watermark encoding according to one 
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embodiment of the present invention. 

Fig. 6 shows changes to the position of the line of 

Fig. 3 to effect watermark encoding according to 

another embodiment of the present invention. 

Fig. 7 is a block diagram of a photocopier according 

to another embodiment of the invention. 

Fig. 8 shows part of an automatic teller machine 

employing principles of the present invention. 

Fig. 9 shows part of a device (e.g. a photocopier, 

scanner, or printer) employing principles of the 

present invention. 

Fig. 10 shows part of a device (e.g. a photocopier, 
scanner, or printer) employing principles of the 
present invention. 

Detailed Description 

[0035] Referring to Fig. 2, an illustrative form of the 
invention employs a grid 10 of imaginary reference 
points arrayed over a line art image. The spacing 
between points is 250 ^im in the illustrated arrangement, 
but greater or lesser spacings can of course be used. 
[0036] Associated with each grid point is a surround- 
ing region 12, shown in Fig. 3. As described below, the 
luminosity (or reflectance) of each of these regions 12 is 
slightly changed to effect the subliminal encoding of 
binary data. 

[0037] Region 12 can take various shapes; the illus- 
trated rounded-rectangular shape is representative 
only. (The illustrated shape has the advantage of 
encompassing a fairly large area while introducing 
fewer visual artifacts than, e.g., square regions.) In 
other embodiments, squares, rectangles, circles, 
ellipses, etc., can alternatively be employed. 
[0038] Fig. 4 is a magnif ied view of an excerpt of Fig. 
3, showing a line 14 passing through the grid of points. 
The width of the line, of course, depends on the partic- 
ular image of which it is a part. The illustrated line is 
about 25 fim in width; greater or lesser widths can natu- 
rally be used. 

[0039] In a first embodiment of the invention, shown in 
Fig. 5, the width of the line is controllably varied so as to 
change the luminosity of the regions through which it 
passes. To increase the luminosity (or reflectance), the 
line is made narrower (i.e. less ink in the region). To 
decrease the luminosity, the line is made wider (i.e. 
more ink). 

[0040] Whether the luminance in a given region 
should be increased or decreased depends on the par- 
ticular watermarking algorithm used. Any algorithm can 
be used, by changing the luminosity of regions 1 2 as the 
algorithm would otherwise change the luminance or 
colors of pixels in a pixelated image. (Some watermark- 
ing algorithms effect their changes in a transformed 
domain, such as DCT, wavelet, or Fourier. However, 
such changes are ultimately manifested as changes in 
luminance or color.) 

[0041] In an exemplary algorithm, the binary data is 



represented as a sequence of -Is and 1s, instead of 0s 
and 1s. (The binary data can comprise a single datum, 
but more typically comprises several. In an illustrative 
embodiment, the data comprises 100 bits - some of 

5 which are error-correcting or -detecting bits.) 

[0042] Each element of the binary data sequence is 
then multiplied by a corresponding element of a 
pseudo-random number sequence, comprised of -1s 
and 1s, to yield an intermediate data signal. Each ele- 

10 ment of this intermediate data signal corresponds to a 
respective sub-part of the image, such as a region 12. 
Collectively, these elements form a pattern of binary 
data. (Typically each element of the intermediate data 
signal is mapped to several of the regions.) 

is [0043] The image in (and optionally around) each 
such region is analyzed to determine its relative capabil- 
ity to conceal embedded data, and a corresponding 
scale factor is produced. Exemplary scale factors may 
range from 0 to 3. The scale lactor for the region is then 

20 multiplied by the element of the intermediate data signal 
corresponding to (i.e. mapped to) the region in order to 
yield a "tweak" (or "bias") value for the region. In the 
illustrated case, the resulting tweaks can range from -3 
to 3. Collectively, these elements form a pattern of gray- 

25 scaled data. 

[0044] The luminosity of the region on the banknote is 
then adjusted in accordance with the corresponding 
tweak value. A tweak value of -3 may correspond to a - 
5% change in luminosity; -2 may correspond to -2% 

30 change; -1 may correspond to -1% change; 0 may cor- 
respond to no change; 1 may correspond to +1% 
change; 2 may correspond to +2% change, and 3 may 
correspond to +5% change. (This example follows the 
basic techniques described in the Real Time Encoder 

35 embodiment disclosed in patent 5,710,834.) 

[0045] In Fig. 5, the watermarking algorithm deter- 
mined that the luminance of region A should be reduced 
by a certain percentage, while the luminance of regions 
C and D should be increased by certain percentages. 

40 [0046] In region A, the luminance is reduced by 
increasing the line width. In region D, the luminance is 
increased by reducing the line width; similarly in region 
C (but to a lesser extent). 

[0047] No line passes through region B, so there is no 
45 opportunity to change the region's luminance. This is 
not fatal to the method, however, since the exemplary 
watermarking algorithm redundantly encodes each bit 
of data in sub-parts spaced throughout the line art 
image. 

so [0048] The changes to line widths in regions A and D 
of Fig. 5 are exaggerated for purposes of illustration. 
While the illustrated variance is possible, most imple- 
mentations will typically modulate the line width 3 - 50% 
(increase or decrease). 

55 [0049] (Many watermarking algorithms routinely oper- 
ate within a signal margin of about +/- 1% changes in 
luminosity to effect encoding. That is, the "noise" added 
by the encoding amounts to just 1% or so of the under- 
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lying signal. Lines typically don't occupy the full area of 
a region, so a 10% change to line width may only effect 
a 1% change to region luminosity, etc. Banknotes are 
different from photographs in that the artwork generally 
need not convey photorealism. Thus, banknotes can be 
encoded with higher energy than is used in watermark- 
ing photographs, provided the result is still aesthetically 
satisfactory. To illustrate, localized luminance changes 
on the order of 10% are possible in banknotes, while 
such a level of watermark energy in photographs would 
generally be considered unacceptable. In some con- 
texts, localized luminance changes of 20, 30, 50 or even 
100% are acceptable.) 

[0050] In the illustrated embodiment, the change to 
line width is a function solely of the tweak to be applied 
to a single region. Thus, if a line passes through any 
part of a region to which a tweak of 2% is to be applied, 
the line width in that region is changed to effect the 2% 
luminance difference. In variant embodiments, the 
change in line width is a function of the line's position in 
the region. In particular, the change in line width is a 
function of the distance between the region's center grid 
point and the line's closest approach to that point. If the 
line passes through the grid point, the full 2% change is 
effected. At successively greater distances, succes- 
sively less change is applied. The manner in which the 
magnitude of the tweak changes as a function of line 
position within the region can be determined by apply- 
ing one of various interpolation algorithms, such as the 
bi-linear, bi-cubic, cubic splines, custom curve, etc. 
[0051] In other variant embodiments, the change in 
line width in a given region is a weighted function of the 
tweaks for adjoining or surrounding regions. Thus, the 
line width in one region may be increased or decreased 
in accordance with a tweak value corresponding to one 
or more adjoining regions. 

[0052] Combinations of the foregoing embodiments 
can also be employed. 

[0053] In the foregoing embodiments, it is sometimes 
necessary to trade-off the tweak values of adjoining 
regions. For example, a line may pass along a border 
between regions, or pass through the point equidistant 
from four grid points ("equidistant zones"). In such 
cases, the line may be subject to conflicting tweak val- 
ues -- one region may want to increase the line width, 
while another may want to decrease the line width. (Or 
both may want to increase the line width, but differing 
amounts.) Similarly in cases where the line does not 
pass through an equidistant zone, but the change in line 
width is a function of a neighborhood of regions whose 
tweaks are of different values. Again, known interpola- 
tion functions can be employed to determine the weight 
to be given the tweak from each region in determining 
what change is to be made to the line width in any given 
region. 

[0054] In the exemplary watermarking algorithm, the 
average change in luminosity across the image is zero, 
so no generalized lightening or darkening of the image 



is apparent. The localized changes in luminosity are so 
minute in magnitude, and localized in position, that they 
are essentially invisible (e.g. inconspicuous/subliminal) 
to human viewers. 

s [0055] An alternative embodiment is shown in Fig. 6, 
in which line position is changed rather than line width. 
[0056] In Fig. 6 the original position of the line is 
shown in dashed form, and the changed position of the 
line is shown in solid form. To decrease a region's lumi- 

w nosity, the line is moved slightly closer to the center of 
the grid point; to increase a region's luminosity, the line 
is moved slightly away. Thus, in region A, the line is 
moved towards the center grid point, while in region D it 
is moved away. 

is [0057] It will be noted that the line on the left edge of 
region A does not return to its nominal (dashed) position 
as it exits the region. This is because the region to the 
left of region A also is to have decreased luminosity. 
Where possible, it is generally preferable not to return a 

20 line to its nominal position, but instead permit shifted 
lines to remain shifted as they enter adjoining regions. 
So doing permits a greater net line movement within a 
region, increasing the embedded signal level. 
[0058] Again, the line shifts in Fig. 6 are somewhat 

25 exaggerated. More typical line shifts are on the order of 
3 - 50 urn. 

[0059] One way to think of the Fig. 6 embodiment is to 
employ a magnetism analogy. The grid point in the 
center of each region can be thought of as a magnet. It 

30 either attracts or repels lines. A tweak value of -3, for 
example, may correspond to a strong -valued attraction 
force; a tweak value of +2 may correspond to a middle- 
valued repulsion force, etc. In Fig. 6, the grid point in 
region A exhibits an attraction force (i.e. a negative 

35 tweak value), and the grid point in region D exhibits a 
repulsion force (e.g. a positive tweak value). 
[0060] The magnetic analogy is useful because the 
magnetic effect exerted on a line depends on the dis- 
tance between the line and the grid point. Thus, a line 

40 passing near a grid point is shifted more in position than 
a line near the periphery of the region. 
[0061] (Actually, the magnetism analogy can serve as 
more than a conceptual tool. Instead, magnetic effects 
can be modeled in a computer program and serve to 

45 synthesize a desired placement of the lines relative to 
the grid points. Arbitrarily customized magnetic fields 
can be used.) 

[0062] Each of the variants discussed above in con- 
nection with Fig. 5 is likewise applicable to Fig. 6. 

so [0063] Combinations of the embodiments of Figs. 5 
and 6 can of course be used, resulting in increased 
watermark energy, better signal-to-noise ratio and, in 
many cases, less noticeable changes. 
[0064] In still a further embodiment, the luminance in 

55 each region is changed while leaving the line 
unchanged. This can be effected by sprinkling tiny dots 
of ink in otherwise-vacant parts of the region. In high 
quality printing, of the type used with banknotes, drop- 
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lets on the order of 3^m in diameter can be deposited. 
(Still larger droplets are still beyond the perception 
threshold for most viewers.) Speckling a region with 
such droplets (either in a regular array, or random, or 
according to a desired profile such as Gaussian), can 
readily effect a 1% or so change in luminosity. (Usually 
dark droplets are added to a region, effecting a 
decrease in luminosity. Increases in luminosity can be 
effected by speckling with a light colored ink, or by form- 
ing light voids in line art otherwise present in a region.) 
(Actually, production realities often mean that many 
such microdots will not print, but statistically some will.) 
[0065] In a variant of the speckling technique, very 
thin mesh lines can be inserted in the artwork -- again to 
slightly change the luminance of one or more regions 
(so-called "background tinting"). 

[0066] To decode watermark data, the encoded line 
art image must be converted into electronic form for 
analysis. This conversion is typically performed by a 
scanner. 

[0067] Scanners are well known, so a detailed 
description is not provided here. Suffice it to say that 
scanners conventionally employ a line of closely spaced 
photodetector cells that produce signals related to the 
amount of the light reflected from successive swaths of 
the image. Most inexpensive consumer scanners have 
a resolution of 300 dots per inch (dpi), or a center to 
center spacing of component photodetectors of about 
84 ^m. Higher quality scanners of the sort found in most 
professional imaging equipment and photocopiers have 
resolutions of 600 dpi (42^m), 1200 dpi (21 ^m), or bet- 
ter. 

[0068] Taking the example of a 300 dpi scanner (84 
photodetector spacing), each 250 region 12 on 
the banknote will correspond to about a 3 x 3 array of 
photodetector samples. Naturally, only in rare instances 
will a given region be physically registered with the 
scanner so that nine photodetector samples capture the 
luminance in that region, and nothing else. More com- 
monly, the line art is skewed with respect to the scanner 
photodetectors, or is longitudinally misaligned (i.e. 
some photodetectors image sub-pans of two adjoining 
regions). However, since the scanner oversamples the 
regions, the luminance of each region can unambigu- 
ously be determined. 

[0069] In one embodiment, the scanned data from the 
line art is collected in a two dimensional array and proc- 
essed - according to one of the techniques disclosed in 
my prior patents and applications -- to analyze the sta- 
tistics of the data (using the techniques disclosed in my 
prior writings) to extract the bits of the embedded data. 
[0070] (Again, the reference to my earlier watermark 
decoding techniques is exemplary only. Once scanning 
begins and the data is available in pixel form, it is 
straightforward to apply any other watermark decoding 
technique to extract a correspondingly-encoded water- 
mark.) 

[0071] In a variant embodiment, the scanned data is 



not assembled in a complete array prior to the process- 
ing. Instead, it is processed in real-time, as it is gener- 
ated, in order to detect embedded watermark data 
without delay. (Depending on the parameters of the 
5 scanner, it may be necessary to scan a half-inch or so of 
the line art image before the statistics of the resulting 
data unambiguously indicate the presence of a water- 
mark.) 

[0072] In accordance with another aspect of the inven- 
io tion, various hardware devices are provided with the 
capability to recognize embedded watermark data in 
any line art images they process, and to respond 
accordingly. 

[0073] One example is a color photocopier. Such 
is devices employ a color scanner to generate sampled 
(pixel) data corresponding to an input media (e.g. a dol- 
lar bill). If watermark data associated with a banknote is 
detected, the photocopier can take one or more steps. 
[0074] One option is simply to interrupt copying, and 
20 display a message reminding the operator that it is ille- 
gal to reproduce currency. 

[0075] Another option is to contact a remote service or 
site, and report the attempted reproduction of a ban- 
knote. Photocopiers with telephone dial-out capabilities 

25 are known in the art (e.g. patent 5,305,199) and are 
readily adapted to this purpose. Similarly, personal 
computers with modems or network communication 
capabilities can send a message to a remote location 
alerting of the attempted reproduction (e.g. over the 

30 internet). The remote service can be an independent 
service, or can be a government agency. 
[0076] Yet another option is to permit the copying, but 
to insert forensic tracer data in the resultant copy. This 
tracer data can take various forms. Steganographically 

35 encoded binary data is one example; the data embed- 
ding shown in patent 5,568,268 can also be used. The 
tracer data can memorialize the serial number of the 
machine that made the copy and/or the date and time 
the copy was made. To address privacy concerns, such 

40 tracer data is not normally inserted in photocopied out- 
put, but is so inserted only when the subject being pho- 
tocopied is detected as being a banknote. (Such an 
arrangement is shown in Fig. 7.) 
[0077] Desirably, the scan data is analyzed on a line- 

45 by-line basis in order to identify illicit photocopying with 
a minimum of delay. If a banknote is scanned, one or 
more lines of scanner output data may be provided to 
the photocopier's reprographic unit before the banknote 
detection decision has been made. In this case the pho- 

50 tocopy will have two regions: a first region that is not 
tracer-marked, and a second, subsequent region in 
which the tracer data has been inserted. 
[0078] Another hardware device tat can employ the 
foregoing principles is a standalone scanner. A pro- 

55 grammed processor (or dedicated hardware) inside the 
scanner analyzes the data being generated by the 
device, and responds accordingly. 
[0079] Yet another hardware device that can employ 
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the foregoing principles is a printer. A processor inside 
the device analyzes graphical image data to be printed, 
looking for watermarks associated with banknotes. 
[0080] For both the scanner and printer devices, 
response strategies can include disabling operation, or 
inserting tracer information. (Such devices typically do 
not have dial-out capabilities or network connections, 
although such capabilities of a conventional computer 
can be invoked by a scanner or printer device using 
known techniques, if desired.) 

[0081 ] Again, it is desirable to process the scanner or 
printer data as it becomes available, so as to detect any 
banknote processing with a minimum of delay. Again, 
there will be some lag time before a detection decision 
is made. Accordingly, the scanner or printer output will 
be comprised of two parts, one without the tracer data, 
and another with the tracer data. 
[0082] In another embodiment (Fig. 10) an impercep- 
tible watermark having a universal ID (UID) is inserted 
into all documents printed with a printer, scanned with a 
scanner, or reproduced by a photocopier. The UID is 
associated with the particular printer/photocopier/scan- 
ner in a registry database maintained by the products' 
manufacturers. The manufacturer can also enter in this 
database the name of the distributor to whom the prod- 
uct was initially shipped. Still further, the owner's name 
and address can be added to the database when the 
machine is registered for warranty service. While not 
preventing use of such machines in counterfeiting, the 
embedded UID facilitates identifying the machine that 
generated a counterfeit banknote. (This is an applica- 
tion in which a private watermark might best be used.) 
[0083] Another advantageous use of digital water- 
marks is in high-confidence authentication of banknotes 
for, e.g., automatic teller machines that both accept -- as 
well as dispense -- cash. Referring to Fig. 8, such a 
machine (1 1) is provided with a known optical scanner 
(13) to produce digital data (15) corresponding to the 
face(s) of the bill (16). This image set (14) is then ana- 
lyzed (16) to extract embedded watermark data. In 
watermarking technologies that require knowledge of a 
code signal (20) for decoding (e.g. noise modulation 
signal, crypto key, spreading signal, etc.), a bill may be 
watermarked in accordance with several such codes. 
Some of these codes are public - permitting their read- 
ing by conventional machines. Others are private, and 
are reserved for use by government agencies and the 
like. (C.f. public and private codes in the present 
assignee's issued patents.) 

[0084] As noted, banknotes presently include certain 
visible structures, or markings (e.g., the seal emblem 
noted in the earlier-cited patents), which can be used as 
aids to note authentication (either by visual inspection 
or by machine detection). Desirably, a note is examined 
by an integrated detection system (24), and confirms 
the presence of both the visible structures (22) and the 
digitally watermarked data before concluding that a 
banknote is genuine. 



[0085] Visible banknote structures can be sensed 
using known pattern recognition techniques. Examples 
of such techniques are disclosed in U.S. Patents 
5,321,773, 5,390,259, 5,533,144, 5,539.841, 

5 5,583,614, 5,633,952, 4,723,149 and 5,424,807 and 
laid-open foreign application EP 766,449. 
[0086] Referring to Fig. 9, a photocopier (30), for 
example, can sense the presence of either a visible 
structure (32) or embedded banknote watermark data 

jo (34), and disable copying if either is present (36). Scan- 
ners and printers can be equipped with a similar capa- 
bility - analyzing the data scanned or to be printed for 
either of these banknote hallmarks. If either is detected, 
the software (or hardware) disables further operation. 

is [0087] Identification of banknotes by watermark data 
provides an important advantage not otherwise availa- 
ble. As noted, an original bill can be doctored (e.g. by 
white-out, scissors, or less crude techniques) to 
remove/obliterate the visible structures. Such a docu- 

20 ment can then be freely copied on either a visible struc- 
ture-sensing photocopier or scanner/printer installation. 
The removed visible structure can then be added in via 
a second printing/photocopying operation. If the printer 
is not equipped with banknote<Jisabling capabilities, 

25 image-editing tools can be used to insert visible struc- 
tures back into image data sets scanned from such doc- 
tored bills, and the complete bill freely printed. By 
additionally including embedded watermark data in the 
banknote, and sensing same, such ruses will not suc- 

30 ceed. 

[0088] (A similar ruse is to scan a banknote image on 
a non-banknote-sensing scanner. The resulting image 
set can then be edited by conventional image editing 
tools to remove/obliterate the visible structures. Such a 
35 data set can then be printed - even on a printer/photo- 
copier that examines such data for the presence of visi- 
ble structures. Again, the missing visible structures can 
be inserted by a subsequent printing/photocopying 
operation.) 

40 [0089] Desirably, the visible structure detector and the 
watermark detector are integrated together as a single 
hardware and/or software tool. This arrangement pro- 
vides various economies, e.g., in interfacing with the 
scanner, manipulating pixel data sets for pattern recog- 

45 nition and watermark extraction, electronically re-regis- 
tering the image to facilitate pattern 
recognition/watermark extraction, issuing control sig- 
nals (e.g. disabling) signals to the photocopier/scanner, 
etc. 

so [0090] While the foregoing applications disabled 
potential counterfeiting operations upon the detection of 
either a visible structure or watermarked data, in other 
applications, both criteria must be met before a ban- 
knote is recognized as genuine. Such applications typi- 

55 cally involve the receipt or acceptance of banknotes, 
e.g. by ATMs as discussed above and illustrated in Fig. 
8. 

[0091] (To provide a comprehensive disclosure with- 
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out unduly lengthening the following specification, appli- 
cants incorporate by reference the patent documents 
cited above.) 

[0092] From the foregoing, it will be recognized that 
embodiments according to the present invention allow 
line art images to serve as subliminal carriers for binary 
data. Additionally, existing deterrents to banknote coun- 
terfeiting have been enhanced to prevent common 
work-arounds, and other advantages have been pro- 
vided. 

[0093] Having described and illustrated the principles 
of my invention with reference to several illustrative 
embodiments, it will be recognized that these embodi- 
ments are exemplary only and should not be taken as 
limiting the scope of my invention. Guided by the forego- 
ing teachings, it should be apparent that other water- 
marking, decoding, and anti-counterfeiting technologies 
can be substituted for, and/or combined with, the ele- 
ments detailed above to yield similar effects. 
[0094] For example, while the invention has been 
described with reference to embodiments employing 
regular rectangular arrays of grid points, those skilled in 
the art will recognize that other arrays of points ~ nei- 
ther rectangular nor regular ~ can alternatively be used. 
[0095] Similarly, while the invention has been particu- 
larly illustrated with reference to banknotes, the princi- 
ples thereof are equally applicable to other security 
documents. 

[0096] While the invention has been described with 
reference to embodiments that scale the embedded 
energy in accordance with local image characteristics, 
in other embodiments a manually crafted energy profile 
can be implemented. That is, a mask defining embed- 
ded signal magnitudes at different parts of the image 
can be manually devised, and employed to tailor the 
change in luminance in each region. 
[0097] Likewise, while one encoding technique has 
been particularly detailed, the invention is not so limited. 
Any technique for hiding plural-bit binary data in a secu- 
rity document, so that it can be detected from sampled 
optical data corresponding to the document, can like- 
wise be employed. Not all such techniques involve slight 
alterations to the ink (e.g. color, density, distribution, 
etc.). For example, another approach is to digitally 
watermark the underlying medium (whether paper, pol- 
ymer, etc.). This can be done by changing the microto- 
pology of the medium (a la mini- Braille) to manifest the 
pattern of encoded data. Such texturing can be optically 
sensed and decoded using a an algorithm correspond- 
ing to the encoding algorithm that produced the pat- 
terned data. Another option is to employ a laminate on 
or within the banknote, where the laminate has the 
watermarking manifested thereon/therein. The laminate 
can be textured (as above), or its optical transmissivity 
can vary in accordance with a noise-like pattern that is 
the watermark, or a chemical property can similarly 
vary. Such approaches are detailed, e.g., in my laid- 
open PCT applications cited above. 



[0098] While the invention has been particularly illus- 
trated with reference to certain hardware devices (e.g. 
scanners, photocopiers, and printers), and certain 
applications (deterring counterfeiting, and banknote 

5 authentication), the technology is not so limited. For 
example, many different devices can be equipped with 
the banknote recognition capabilities detailed herein. 
One example is cash-accepting vending machines, 
which examine bills for authenticity. Another is personal 

70 computers, which can examine data processed thereby 
to determine whether same originated with a banknote, 
and to intervene as appropriate. 
[0099] Still other applications can also be served by 
this technology as well. One is banknote processing, 

is e.g. the devices used by banks and issuing authorities 
for counting, sorting, and reading banknotes, and cull- 
ing from circulation certain aged and counterfeit ban- 
knotes. Such a device can include an input (e.g. hopper) 
for receiving plural banknote bills, and a leed mecha- 

20 nism for conveying bills from the input past an optical 
detector. The optical detector produces digital image 
data corresponding to the conveyed bills. This image 
data is then processed by a processor, which detects 
plural-bit digital watermark data steganographically 

25 encoded in artwork on at least certain of said ban- 
knotes. A control unit responds in a manner dependent 
on the detected watermark data. For example, the con- 
trol unit can cause the device to sort bills by denomina- 
tion or age, or cull counterfeits, based on the decoded 

30 data. 

[0100] Moreover, it will be recognized that the meth- 
ods of the invention can be performed by hardware, 
software, or by a combination (e.g. some image 
processing operations performed by dedicated hard- 
35 ware, with others performed in software). 

[0101] In still other embodiments, at least part of a 
watermark can be printed using photoluminescent ink. 
This allows, e.g., a merchant presented with a banknote 
to quickly verify the presence of *some* watermark-like 
40 indicia in/on the bill even without resort to a scanner and 
computer analysis (e.g. by examining under a black 
light). Such photoluminescent ink can also print human- 
readable indicia on the bill, such as the denomination of 
a banknote. (Since ink-jet printers and other common 
45 mass-printing technologies employ cyan/magenta/yel- 
low/black to form colors, they can produce only a limited 
spectrum of colors. Photoluminescent colors are out- 
side their capabilities. Fluorescent colors - such as the 
yellow, pink and green dyes used in highlighting mark- 
so ers - can similarly be used and have the advantage of 
being visible without a black light.) 
[0102] An improvement to the detailed, and other, 
encoding techniques is to add an iterative assessment 
of the robustness of the digital watermark, with a corre- 
55 sponding adjustment in a re-watermarking operation. 
Especially when encoding multiple bit watermarks, the 
characteristics of the underlying content (e.g. artwork) 
may result in some bits being more robustly (e.g. 
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strongly) encoded than others. In an illustrative tech- 
nique employing this improvement, a watermark is first 
encoded. Next, a trial decoding operation is performed. 
A confidence measure (e.g. signal-to-noise ratio) asso- 
ciated with each bit detected in the decoding operation 5 
is then assessed. The bits that appear weakly encoded 
are identified, and corresponding changes are made to 
the watermarking parameters to bring up the relative 
strengths of these bits. The object is then watermarked 
anew, with the changed parameters. This process can 10 
be repeated, as needed, until all of the bits comprising 
the encoded data are approximately equally detectable 
from the encoded object, or meet some predetermined 
signal-to-noise ratio threshold. 

[0103] Banknotes, like most other media and objects, 15 
can generally benefit by use of multiple watermarks. For 
example, a banknote can be marked once in the spatial 
domain, and a second time in the spatial frequency 
domain. (It should be understood that any change in 
one domain has repercussions in the other. Here I refer- 20 
ence the domain in which the change is directly 
effected.) 

[0104] Another option is to mark a banknote (or other 
physical or digital object) with watermarks of two differ- 
ent levels of robustness, or strength. The more robust 25 
watermark withstands various types of corruption, and 
is detectable in the object even after multiple genera- 
tions of intervening distortion. The less robust water- 
mark can be made frail enough to fail with the first 
distortion of the object. In a banknote, for example, the so 
less robust watermark serves as an authentication 
mark. Any scanning and reprinting operation will cause 
it to become unreadable. Both the robust and the frail 
watermarks should be present in an authentic ban- 
knote; only the former will be present in a counterfeit. 35 
[0105] Still another option is to encode two different 
watermarks in accordance with two different code sig- 
nals. One watermark can identify an apparatus used in 
an attempted counterfeiting operation (e.g. by serial 
number). The other watermark can be used for other 40 
purposes. 

[0106] The foregoing discussion has addressed vari- 
ous technological fixes to various problems, particularly 
illustrated in connection with banknotes. Exemplary 
solutions have been detailed. Others will be apparent to 45 
the artisan by applying common knowledge to extrapo- 
late from the solutions provided above. 
[0107] For example, the technology and solutions dis- 
closed herein have made use of elements and tech- 
niques known from the cited references. Other elements so 
and techniques from the cited references can similarly 
be combined to yield further implementations within the 
scope of the present invention. Thus, for example, holo- 
grams with or without watermark data can be employed 
in banknotes for additional security; single-bit water- ss 
marking can commonly be substituted for multi-bit 
watermarking; technology described as using imper- 
ceptible watermarks can sometimes be practiced using 



visible watermarks (glyphs, etc.); local scaling of water- 
mark energy can be provided to enhance watermark 
signal-to-noise ratio without increasing human percepti- 
bility; various filtering operations can be employed for 
various functions; encoding may proceed at the granu- 
larity of a single pixel (or DCT coefficient), or may simi- 
larly treat adjoining groups of pixels (or DCT 
coefficients); the encoding can be optimized to with- 
stand expected forms of content corruption. Etc., etc., 
etc. (The cited variants are generally all further detailed 
in my laid-open PCT applications.) Thus, the exemplary 
embodiments are only selected samples of the solu- 
tions available by combining the teachings referenced 
above. The other solutions necessarily are not exhaus- 
tively described herein, but are fairly within the under- 
standing of an artisan given the foregoing disclosure 
and familiarity with the cited art. 

[0108] In view of the many possible embodiments to 
which the principles of the invention may be put, it 
should be recognized that the detailed embodiments 
are illustrative only and should not be taken as limiting 
the scope of my invention. Rather, I claim as my inven- 
tion all such embodiments as may come within the 
scope and spirit of the following claims and equivalents 
thereto. 

[0109] The features disclosed in the foregoing 
description, in the claims and/or in the accompanying 
drawings may, both separately and in any combination 
thereof, be material for realising the invention in diverse 
forms thereof. 

Claims 

1. A method of enhancing the security of a printed 
banknote, the method including marking the face of 
the banknote with machine readable, generally 
imperceptible data, the method characterized by 
selecting digital data with which the banknote is to 
be marked, and slightly altering the distribution of 
ink on the face of the banknote so as to effect 
encoding of said digital data. 

2. The method of claim 1 in which the digital data com- 
prises plural bits. 

3. The method of claim 2 in which all of the plural bits 
are encoded redundantly across the banknote, 
rather than the banknote being marked a single 
localized region only. 

4. The method of claim 1 in which the encoding makes 
use of a code signal. 

5. The method of claim 1 in which the encoding makes 
use of a discrete cosine transform. 

6. The method of claim 1 which includes encoding 
with two different digital watermarks. 
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7. The method of claim 6 in which the two different 
digital watermarks are of different robustness. 

8. The method of claim 6 in which the two watermarks 
are encoded in accordance with different code sig- 5 
nals. 

9. The method of claim 1 which also includes provid- 
ing the banknote with a hologram. 

w 

10. A method for encoding plural-bit digital data in a 
banknote, to facilitate later machine identification of 
the banknote, comprising: 

generating a pattern of data in which the plural- 75 
bit digital data is encoded; 
receiving initial banknote artwork; 
adjusting the initial banknote artwork in accord- 
ance with said data; and 

printing a banknote corresponding to said 20 
adjusted banknote artwork. 

1 1 . The method of claim 1 0 in which the initial banknote 
artwork includes line art, and the method includes 
slightly changing the positions of lines comprising 25 
said artwork to encode said plural-bit data. 

12. The method of claim 11 that includes, for at least 
one line, changing its position in a first direction at a 
first region therealong, and changing its position in 30 
a second direction different than the first at a sec- 
ond region therealong. 

13. The method of claim 10 in which the banknote art- 
work includes line art, and the method includes 35 
slightly changing the widths of lines comprising said 
artwork to encode said plural-bit data. 

14. The method of claim 13 that includes, for at least 
one line, increasing its width in a first region, and 40 
decreasing its width in a second region. 

15. The method of claim 10 that includes: 

defining an array of regions spanning at least 45 
an excerpt of the initial banknote artwork; and 
changing the artwork within plural of said 
regions to either increase or decrease the 
respective luminance of each. 

50 

16. The method of claim 15 in which the defining 
includes imposing a virtual grid over said excerpt. 

17. The method of claim 10 that includes adjusting said 
original artwork by inserting one or more new lines 55 
therein. 

18. A method of deterring reproduction of a banknote, 



comprising: 

encoding the banknote with plural-bit digital 
data; 

providing sampled image data corresponding 
to said banknote; 

analyzing said image data to detect the digital 
data therein, said detection signifying that the 
image data likely corresponds to a banknote; 
and 

intervening in response to detection of the dig- 
ital data. 

19. The method of claim 18 which includes encoding 
the banknote with said digital data across its sur- 
face, wherein the method cannot be defeated by 
obliterating localized markings characteristic of a 
banknote and thereafter reinserting such markings. 

20. The method of claim 18 which further includes: 

analyzing said image data to detect a visible 
structure characteristic of a banknote; and 
intervening in response to detection of the visi- 
ble structure; 

wherein detection of either the visible structure 
or the digital data serves to trigger the interven- 
tion. 

21. The method of claim 18 in which the intervening 
comprises preventing reproduction of the image 
data. 

22. The method of claim 18 in which the intervening 
comprises sending a message to a remote location 
to signal processing of banknote data. 

23. The method of claim 18 in which the intervening 
comprises inserting forensic tracing data in the 
image data. 

24. The method of claim 22 in which the intervening 
comprises inserting first and second plural-bit dig- 
ital watermarks in the image data, one of said 
watermarks serving to convey data identifying an 
apparatus involved in attempted reproduction of the 
banknote. 

25. The method of claim 24 in which the first and sec- 
ond digital watermarks are of different robustness. 

26. The method of claim 24 in which the first and sec- 
ond watermarks are encoded in accordance with 
different code signals. 

27. A method of deterring reproduction of a banknote, 
comprising: 
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at a first site, examining suspect image data 
corresponding to the sampled optical lumi- 
nance of an object; 

determining at said first site whether said sus- 
pect image data corresponds to a banknote; 5 
and 

if so, contacting a second site and reporting 
detection of banknote-related data. 

28. A method of marking printer output from a personal io 
computer system to permit its later identification, 
the system including at least a personal computer 
and a printer, the method comprising: 

receiving printer data being sent from the com- 75 
puter to the printer; 

encoding the printer data with a machine read- 
able, generally imperceptible, digital watermark 
comprising plural bits of digital data, said digital 
watermark serving to mark the printer data as 20 
having been printed by said printer; 
wherein a document printed by said printer 
bears said digital watermark, permitting the 
printer on which said document was printed to 
be identified. 

29. An apparatus for validating a banknote comprising: 

an optical scanner for producing image data 
corresponding to a note input to the apparatus; 30 
a processor for detecting watermark data 
within the image data, the watermark data 
comprising plural digital bits, the detection of 
such watermark data indicating that the note is 
a banknote; and 35 
a control unit that responds in a first manner if 
the processor detects watermark data within 
the image data, and that responds in a second, 
different, manner if the processor does not 
detect watermark data within the image data. 40 

30. The apparatus of claim 29 in which the processor 
has an input through which a code signal is applied, 
the code signal being required for discerning the 
watermark data from the image data. 45 



banknotes from users thereof. 

33. Apparatus for detecting the attempted counterfeit- 
ing of banknotes, comprising: 

a banknote having line art thereon; 
a scanner for scanning the banknote; and 
a steganographic watermark detector for 
decoding binary data encoded within the ban- 
knote line art and scanned by the scanner, the 
presence of said decoded binary data indicat- 
ing the attempted counterfeiting of a banknote. 

34. Apparatus according to claim 33, further compris- 
ing a control unit responsive to the decoded binary 
data for initiating insertion of tracer data in an out- 
put produced by the apparatus. 

35. Apparatus according to claim 34 in which the tracer 
data includes data related to the date of copying. 



36. Apparatus according to claim 34 in which the tracer 
data comprises a steganographic watermark. 

25 37. Apparatus according to claim 34 in which there is a 
delay in said decoding so that, when scanning a 
banknote, the apparatus initially produces output 
not having the tracer data inserted therein, and said 
output thereafter includes the tracer data. 



38. Apparatus for processing cash, comprising: 

an input for receiving a plural banknote bills; 
a feed mechanism for conveying bills from the 
input; 

an optical detector for producing digital image 

data corresponding to bills conveyed thereby 

by the feed mechanism; 

a processor for detecting plural-bit digital data 

steganographically encoded in artwork on at 

least certain of said banknotes; and 

a control unit responsive to detection of said 

plural bit digital data. 



31. The apparatus of claim 29 in which: 



the processor also analyzes the image data for 
a visible structure characteristic of a banknote; 
and 

the control unit responds in the first manner 
only if both the watermark data and the visible 
structure are detected in the image data by the 
processor. 



50 
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32. An automatic teller machine according to claim 31 , 
said machine serving both to dispense and accept 
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Fig. 1A 
(Prior art) 




Fig. 1B 
(Prior art) 
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(54) Digital watermarking and banknotes 

(57) Machine-readable data is digitally water- 
marked into banknotes. Such watermarking can be opti- 
cally sensed and detected by various devices. In 
response, such devices can intervene to prevent ban- 
knote reproduction. This arrangement addresses vari- 
ous problems, e.g., the use of digital image editing tools 
to circumvent prior art banknote anti-copy systems. In 
some embodiments, visible structures characteristic of 
banknotes are also detected (e.g. by pattern recognition 
analysis of image data), and reproduction can be halted 
if either the visible structures or the digital watermark 
data are detected. In other embodiments, automatic 
teller machines that accept, as well as dispense, ban- 
knotes can check for the presence of digitally water- 
marked data to help confirm the authenticity of 
banknotes. In other embodiments, scanners, printers 
and photocopiers can be provided with digital water- 
marking capabilities so that image data, or printed out- 
put, produced by such devices includes digital 
watermark data, permitting subsequent identification of 
the particular device used. The digital watermarking can 
be effected by making slight alterations to ink color, den- 
sity, etc., or by texturing the microtopology of the ban- 
knote surface. Some embodiments effect the 
watermarking by modulating the width or placement of 
component lines that form line art imagery on the ban- 
knote. 
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